Bayes and big data: the consensus Monte Carlo algorithm
نویسندگان
چکیده
منابع مشابه
Bayes and Big Data: The Consensus Monte Carlo Algorithm
A useful definition of “big data” is data that is too big to comfortably process on a single machine, either because of processor, memory, or disk bottlenecks. Graphics processing units can alleviate the processor bottleneck, but memory or disk bottlenecks can only be eliminated by splitting data across multiple machines. Communication between large numbers of machines is expensive (regardless ...
متن کاملVariational Consensus Monte Carlo
Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large datasets typical of modern machine learning. The recently proposed consensus Monte Carlo algorithm removes this limitation by partitioning the data and drawing sam...
متن کاملVariational Bayes on Monte Carlo Steroids
Variational approaches are often used to approximate intractable posteriors or normalization constants in hierarchical latent variable models. While often effective in practice, it is known that the approximation error can be arbitrarily large. We propose a new class of bounds on the marginal log-likelihood of directed latent variable models. Our approach relies on random projections to simplif...
متن کاملMonte Carlo Dose Algorithm
Conventional dose calculation algorithms, such as Pencil Beam are proven effective for tumors located in homogeneous regions with similar tissue consistency such as the brain. However, these algorithms tend to overestimate the dose distribution in extracranial regions such as in the lung and head and neck regions where large inhomogeneities exist. Due to the inconsistencies seen in current calc...
متن کاملSimple Monte Carlo and the Metropolis algorithm
We study the integration of functions with respect to an unknown density. Information is available as oracle calls to the integrand and to the nonnormalized density function. We are interested in analyzing the integration error of optimal algorithms (or the complexity of the problem) with emphasis on the variability of the weight function. For a corresponding large class of problem instances we...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Management Science and Engineering Management
سال: 2016
ISSN: 1750-9653,1750-9661
DOI: 10.1080/17509653.2016.1142191